Lagrangian phase transitions in nonequilibrium 
thermodynamic systems 



> 

Lorenzo Bertini 



cd 



X 



Dipartimento di Matcmatica, Universita di Roma La Sapienza 
E-mail: bertini@mat.uiiiromal.it 



CO 

g ! Alberto De Sole 

Dipartimento di Matematica, Universita di Roma La Sapienza 

E-mail: desoleOmat . uniromal . it 
03 
•«— > 

c*3 



Davide Gabrielli 

Dipartimento di Matematica, Universita dell'Aquila 



f^j , E-mail: gabriell@univaq.it 

O. 

Giovanni Jona-Lasinio 

Dipartimento di Fisica and INFN, Universita di Roma La Sapienza 
CO 
^- ■ E-mail: gianni . j onaOromal . inf n . it 

ov 

00 

Claudio Landim 

IMPA and CNRS UMR 6085, Universite de Rouen 

in ; 

<^> E-mail: landim@impa.br 

^H . 

Abstract. In previous papers we have introduced a natural nonequilibrium free 
energy by considering the functional describing the large fluctuations of stationary 
nonequilibrium states. While in equilibrium this functional is always convex, in 
^5 ■ nonequilibrium this is not necessarily the case. We show that in nonequilibrium a 

new type of singularities can appear that are interpreted as phase transitions. In 
particular, this phenomenon occurs for the one-dimensional boundary driven weakly 
asymmetric exclusion process when the drift due to the external field is opposite to 
the one due to the external reservoirs, and strong enough. 
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1. Introduction 

Irreversible nonequilibrium phenomena have been central in statistical mechanics 
research in the last decades. In the last ten years the authors have developed a 
new approach to nonequilibrium statistical mechanics inspired and supported by the 
analysis of stochastic lattice gases [IHI]. This theory is applicable to a wide class of 
thermodynamic systems where diffusion is the dominant mechanism. For example, as 
shown in j5j|6], this theory leads to the prediction of universality properties for current 
fluctuations. A basic ingredient of the theory is the so called quasi-potential, a concept 
introduced in the analysis of stochastically perturbed dynamical systems [7], which 
provides a natural definition of a nonequilibrium thermodynamic potential. 

In this letter we discuss the occurrence of singularities of the quasi-potential for 
nonequilibrium systems with infinitely many degrees of freedom. We analyze in detail 
the weakly asymmetric exclusion process and show analytically that, when the external 
field is strong, these singularities do appear. The singularities of the quasi-potential 
are interpreted as nonequilibrium phase transitions. Examples of phenomena of this 
kind in a finite dimensional setting have been discussed in the literature and have also 
been observed in simulations [51-fTO]. The present work is the first example in which 
a thermodynamic model, that is a system with infinitely many degrees of freedom, is 
shown to exhibit such a singular behavior. 

2. Macroscopic fluctuation theory 

The dynamical macroscopic behavior of the system in a d- dimensional volume A is 
described by a nonlinear driven diffusion type equation of the form 

p t + V-a(p)E = V-D(p)Vp, (1) 

where p = p(t, x) represents the thermodynamic variable, e.g. the density, and p t is its 
time derivative. The diffusion coefficient D and the mobility a are dx d matrices and E 
denotes the external field. The transport coefficients D and a satisfy the local Einstein 
relation D(p) = a(p) s"(p) where s is the equilibrium free energy of the homogeneous 
system. Equation (CQ) has to be supplemented by the appropriate boundary conditions 
due to the interaction with the external reservoirs. We denote by p = p(x) the stationary 
solution of ([I]). 

The hydrodynamic equation ([I]) can be derived from an underlying microscopic 
dynamics through a suitable scaling limit. It represents the typical behavior, as the 
number N of degrees of freedom diverges, of the empirical density profile pN(t, x) defined 
as the average number of particles at time t in a macroscopic infinitesimal volume around 
x. The validity of the local Einstein relationship can then be deduced from the local 
microscopic detailed balance [TT] . 

The probability that in the time interval [Ti,T2J the evolution of the variable pN 
deviates from the solution of the hydrodynamic equation and is close to some trajectory 
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p, is exponentially small and of the form 

P (p N (t, x) « p{t, x)) « e-^^i.^lW ; ( 2 ) 

where ip\,T 2 ](p) is a functional which vanishes if p is a solution of ([I]). The functional 
J[t 1 ,t 2 ](p) represents the energetic cost necessary for the system to follow the trajectory p. 
In the case of stochastic lattice gases, the expression of I[T lt T 2 ] can be obtained from the 
microscopic dynamics as the large deviation rate functional [HHUT2]. Following [13], we 
next sketch a purely macroscopic argument which yields the same conclusion. Consider 
a time dependent variation F = F(t,x) of the external field so that the total applied 
field is E + F. Denote by p F the corresponding solution of ([1]). By minimizing the 
energy dissipated by the field F with the constraint that p F equals the prescribed path 
p we obtain that 

W«(P) = 7 I" {F-a{p)F)dt, (3) 



where (■) is the integration over space and the optimal field is given by F = 2VH, where 
H is the unique solution to the Poisson equation 

- 2V • a(p)VH = pt + W ■ cr(p)E - V • D(p)Vp (4) 

which vanishes at the boundary of A for any i£ [Ti, T 2 ] . 

The quasi-potential V(p) is defined as the minimal cost to reach the density profile 
p starting from the stationary profile p: 

V(p) = inf |/(_oo,o](p) , P ■ p(-oo) = p, p(0) = pj . (5) 

Therefore, while /[Ti,t 2 ](p) measures how much a path p is close to the solution of 
([1]), the quasi-potential V(p) measures how much a profile p is close to the stationary 
solution p. Moreover, V is proportional to the total work done by the external field 
along the optimal time evolution to reach the density profile p [13]. In the context 
of nonequilibrium stationary states of stochastic lattice gases the quasi-potential gives 
the asymptotics, as the number of degrees of freedom diverges, of the probability of 
observing a static fluctuation of the density: p (pn(x) ~ p( x )) ~ e ~ NV (p)^ where p is 
the stationary state of the microscopic dynamics. This makes natural to interpret V as 
a nonequilibrium free energy. In particular, for equilibrium systems p has the standard 
Gibbs form and the quasi-potential coincides with the variation of the free energy. 

3. Hamiltonian picture 

By considering the functional I[Ti,t 2 ] defined in ([3} as an action functional, i.e. 
I[Ti,t 2 ](p) — J T 2 ^(PiPt)dt for a Lagrangian L(p, p t ) obtained by solving (J3J and 
expressing the external field F in terms of p and pt, the variational problem (|5]) can 
be viewed as the minimal action principle of classical mechanics. The corresponding 
Hamiltonian H is given by 

M(p, tt) = (Vtt ■ o-(p)Vn) + (Vtt • [a(p)E - D(p)V >]> 
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where at the boundary of A the value of p is prescribed by the external reservoirs and 
the momentum tt vanishes [2]. The canonical equations associated to the Hamiltonian 
H are 

' Pt + V • a{p)E = V • D{p)Vp - 2V • a(p)Vvr 
ix t + E ■ a'{p)V-K = -Vvr ■ a'(p)V7r - D(p)VV7T [ ' 

in this formula, D(p)Wn = J2ij D i,j(p)dl t ^TT. 

Recalling that p is the stationary solution to ([I]), (p, 0) is an equilibrium solution 
of ([H]) belonging to the zero energy manifold H(p, tt) = 0. Any solution p(t) of the 
hydrodynamical equation ([I]) corresponds to a solution (p(£), 0) of the Hamilton equation 
([6]) which converges, as t — )■ +oo, to the equilibrium point (p, 0) and the corresponding 
action vanishes. The set {(p,ir) : tt = 0} is therefore the stable manifold M s associated 
to the equilibrium position (p, 0). The unstable manifold M u is defined as the set of 
points (p, 71") such that the solution of the canonical equations §6§ starting from (p, tt) 
converges to (p, 0) as t — > — oo. By the conservation of the energy, M u is also a subset 
of the zero energy manifold. 

A basic result in Hamiltonian dynamics is the following [133 • Given a closed 
curve 7 = {(p(a), vr(a)) , a € [0,1]}, the integral § {n dp) = J (n(a) p a {a)) da is 
invariant under the Hamiltonian evolution. This means that, by denoting with ^(t) 
the evolution of 7 under the Hamiltonian flow, § ^Ait dp) = § (it dp). In view of this 
result, if 7 is a closed curve contained in the unstable manifold M u then § (71 dp) = 
limt^.oo § , t > (71 dp) = 0. We can therefore define the pre-potential W : M u — > R by 

W(p,ir) = [(7} dp), (7) 

where the integral is carried over a path 7 = (p, tY) in M u which connects (p, 0) to (p, it). 
The possibility of defining such potential is usually referred to by saying that M u is a 
Lagrangian manifold. 

The relationship between the quasi-potential and the pre-potential is given by 

V(p) = inf {W(p, vr) , vr : (p, vr) G M u } . (8) 

Indeed, fix p and consider it such that (p, it) belongs to M u . Let (p{t),fr(t)) be the 
solution of the Hamilton equation (jHJ) starting from (p, 71") at t = 0. Since (p, 71") G M u , 
(p(t), 7r(£)) converges to (p, 0) as t — > — 00. Therefore, the path p(t) is a solution of the 
Euler-Lagrange equations for the action J(_ 00j o], which means that it is a critical path 
for ((5]). Since L(p,p t ) = (it pt) — H(p, #) and H(p(t),7r(t)) = 0, the action of such path 
p{t) is given by Ii-oo,o]{p) — W(p, tt). The right hand side of ([8]) selects among all such 
paths the one with minimal action. 

In a neighborhood of the fixed point (p, 0), the unstable manifold M u can be written 
as a graph, namely it has the form M u = {(p, tt) : tt = m u (p)} for some map m u . In 
this case, the infimum on the right hand side of ([8]) is trivial and V(p) = W(p,m u (p)). 
In general, though, this is not true globally and it may happen, for special p, that the 
variational problem on the right hand side of (E]) admits more than a single minimizer 
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Figure 1. (a) Picture of the unstable manifold, (b) Graph of the quasi-potential. p c 
is a caustic point. 

(Figure l.a). In this case there is also more than one minimizer for the variational 
problem (jSJ). The set of profiles p for which the minimizer is not unique is called the 
caustic. In general, it is a codimension one submanifold of the configuration space. We 
call the occurrence of this situation a Lagrangian phase transition. In this case, profiles 
arbitrarily close to each other but lying on opposite sides of the caustic are reached by 
optimal paths which are not close to each other. This implies that on the caustics the 
first derivative of the quasi-potential is discontinuous (Figure l.b). In particular, the 
occurrence of this phenomenon can be described as a first order phase transition. Of 
course, there exist also profiles for which the transition becomes of higher order. 

Lagrangian phase transitions cannot occur in equilibrium. In this case the quasi- 
potential is in fact always convex, the unstable manifold is globally a graph, and the 
occurrence of a first order phase transition is due to a flat part in the quasi-potential. 
In contrast, in nonequilibrium systems the quasi-potential can be non-convex [T5|[T6] 
and Lagrangian phase transitions can arise when projecting the pre-potential W, which 
is a smooth function on the unstable manifold M u , onto the configuration space. 



4. Microscopic model 

We next show that a Lagrangian phase transition occurs in a simple nonequilibrium 
model, the one dimensional asymmetric simple exclusion process on a lattice of N sites 
with open boundaries. Each site i/N, 1 < i < N, is either empty or occupied by a 
single particle. Each particle independently attempts to jump to its right neighboring 
site with rate p and to its left neighboring site at rate q; we assume p > q. At the 
boundary sites particles are added and removed: a particle is added at site 1, when the 
site is empty, at rate p and removed, when the site is occupied, at rate 1 — p ; similarly 
particles are added to site N at rate p\ and removed at rate 1 — p\. The phase diagram 
of the model, corresponding to the typical behavior of the empirical density as N — > oo, 
can be derived from an algebraic representation of the invariant measure [HIIT7J. Such 
phase diagram exhibits a phase coexistence when < po < Pi < 1 and po + Pi = 1- Note 
that the phase diagram can also be constructed just looking at the entropic stationary 
solutions to the inviscid Burgers equation p t + (p — q)[p(l — p)] x = with the boundary 
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conditions p(0) = p , p(l) = p\ [TS] . 

We consider the weakly asymmetric exclusion process which is obtained by choosing 
p — q = E/N with E > and q = 1 [Tjj]. We also assume < po < pi < 1 so that 
there is a competition between the external field and the boundary conditions. With 
these choices, the hydrodynamic equation, obtained in the diffusive scaling limit, is (CQ) 
with A given by the interval [0,1], D — 1, a — p(l — p), and boundary conditions 
p(t,0) = po, p(t, 1) = p\. The unique stationary solution of ([T]), denoted by p B , can 
be computed explicitly In particular, in the weakly asymmetric regime the phase 
diagram does not exhibit any phase coexistence. The Einstein relation holds with 
s(p) =plogp+(l -p)log(l -p). 

To compute the quasi-potential we consider the Hamiltonian flow ([6]). It is 
convenient to perform the symplectic change of variables p = s'(p) — ir, ip = p. In 
the new variables (p,ip) the Hamiltonian H.(p,ip) = M.(ip,s'(ip) — p) reads 

§(<p, ip) = (p x ip(l - ip) p x ) - ([ip x + Eip{l - ip)} p x ) +E( Pl - p ) 

where we used that p(0) = p , p(l) = p\. The corresponding canonical equations are 

<Pt = Pxx - (1 - 2-0) p x (E - ipx) , , 

ipt = -ip xx - E [ip{l - ip)] x + 2 [V(l - if) p x } x . U 

In the new variables the fixed point (p E ,0) becomes {s'(p E ),p E ). The associated 
stable manifold is {(p,ip) : p = s'(ip)}. We claim that the unstable manifold is given 
by 

M u ={(^) : V = — j— - ( t XX , 0<p x <E\. (10) 

I l + ev p x {E-p x ) ) 

Indeed, pick a point (<p, ip) G M u and let p be the solution to 

<p< = -<pxx + T— — ^<px(-E - p x ) 

with initial condition <p(0) = p. Set now 

1 Pa 



ip 



'XX 



1 + e^ ^(E - ^) 

and observe that ^(O) = ip since (tp,ip) G M u . Then, a tedious computation that we 
omit shows that (<p, ip) is a solution to the canonical equations ([9]) which converges to 
the fixed point {s'(p E ),p E )) as t — >■ — oo. Note that in the variables ((p,ip) the unstable 
manifold M u is a graph. 

The computation of the pre-potential is easily achieved in the new variables 
(<p,ip). We start with the generating function of the symplectic transformation. Let 
F(p, p) = J Q [s(p) — pp]dx be the so-called free generating function [HJ § 48], so that 
tc = 5F/5p, ip = —SF/Sp. Equivalently, dF = (ir,dp) — (ip,dp). Hence, for any path 
r = {j(t), t G [0, 1]} in the phase space 

ndp)= f(ipcbp) + F( 7 (l))-F( 7 (0)). 
r Jt 
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Assume now that V C M u . By (TTU|) . we have that 

(ipd<p)= [ Mt)-\og(l + e^) + s( Vx (t)/E)}dx 



T Jo 

Therefore, if we define Ge by 



t=\ 



t=o 



G E {p,<p)= I Up) + s(<p x /E) + (I -p)<p- log (l + e* 
Jo L 

the previous identities imply that 

(n,dp) = G E (p(i)Ml)) ~ Se(p(0)M0))- 



dx 



'r 
Hence, by flZJ), W^(p, 7r) = Ge(p,¥>) ~ Ge(p E i s '(Pe))i where (<p,p) 6 M u . Therefore, 

V E (p) = wf{g E (p,<p) ,<p: (<p,p)E M u } - Ge(Pe,s'(p e )) • (11) 

In the previous formula the condition that (<p, p) G M u can be dropped since it is 
equivalent to the condition that <p is a critical point of Ge(p, <p)- 

A similar formula for the quasi-potential Ve in the case p > p\ has been obtained 
in [19] by combinatorial techniques. Analogous expression for the quasi-potential in 
terms of a trial functional like Ge appeared in [121 [El [El ED]- However, its intrinsic 
significance in terms of the Hamilton structure behind the variational problem (jSJ) is new 
and answers a question raised in [20J. In particular, equation (2) in [20] characterizes 
the unstable manifold. 

5. Lagrangian phase transitions 

We next show that, when p < Pi an d the external field E is large enough, the weakly 
asymmetric exclusion process exhibits Lagrangian phase transitions. This is not the 
case when the external field and the reservoirs push in the same direction. We refer 
to [21] for the mathematical details. 

We start by arguing that, when E is not large, Lagrangian phase transitions do 
not occur. Let <pi = s'(pi) = log[pj/(l — p^)], i = 0,1, be the chemical potentials 
associated to the boundary reservoirs. When E = Eq = <pi — <po there is no current 
and the microscopic dynamics satisfies the detailed balance. Therefore, in this case, the 
unstable manifold is globally a graph and there exists a unique minimizing path for (jSJ). 
By perturbing around equilibrium, this is still the case when E is close to E Q . 

Consider now the limiting case E = oo which corresponds to the asymmetric simple 
exclusion process examined in [16]. In this singular limit the hydrodynamic equation 
(fll) becomes the inviscid Burgers equation and shocks are possible. In this limit the 
functional Ge becomes 



G{p,ip)= [ kp) + (l-pV-log(l + e* 
Jo L 



dx 



Since G is a concave functional of <p, the minimum of G(p, <p) is attained when 
if is at the boundary of the function space. Since <p(0) = <po> <p(l) = V 9 ! an d 
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if is increasing, the boundary of the function space is given by the step functions 
ip^(x) — cpo + (cpi — ifo) i9(x — y), y G [0, 1], where $ is the Heaviside function. The 
profile ip( y > jumps from <po to <pi at y. The variational problem for V is therefore reduced 
to the one dimensional problem 

i 



mm 

i/e[o,i] 



s(p) + (1 - p)<p (y) - log (1 + e 



,(»)> 



dr 



(12) 



which is equivalent to the expression derived in [lb] . 

It is not difficult to show that, if the density profile p is suitably chosen, (TT2|) admits 
two minimizers. Let 

log(l + e^) -log(l + e Vo ) 



A=l- 



po 



and fix a density profile p : [0, 1] -> [0, 1] satisfying the following conditions, see 
Figure 2. There exist < |/_ < y < y + < 1 such that: p(yo) = p(y±) = A, 
p(x) < A for x G [0,?/_) U (y ,y + ), p(x) > A for x G (y-,yo) U (y + , 1), and p satisfies 
J y+ pdx = A(y + — y_). It is simple to check that there are two global minimizers for 



the variational problem ( 112]) . which are given by ?/± 



Figure 2. 

equal area. 



.4 





__ P(^) ;/ 


p\ 






U y_ 


yo y+ 





X 



Graph of a caustic density profile for E — oo. The shaded regions have 



We finally argue that the occurrence of Lagrangian phase transitions persists when 
the external field E is large. If we consider the density profile p(x) in Figure 2, Ge{p, V 9 )? 
as a functional of <p, will have two local minima close to (p( y± > and only one of them is the 
global minimizer. However we can modify, depending on E, the density profile p in such 
a way that the two local minima are brought back at the same level. In view of ffTQ]) . 
two optimal paths for the variational problem (JSJ) can be constructed by the following 
algorithm. Given the density profile p(x), let p ± (x) be two minimizers for the variational 
problem §U$ and set F^ = e v± /(l + e v± ). Denote by F ± = F ± {t } x) the solution of 
the viscous Burgers equation F t + E(F(1 — F)) x = F 9 
F(t,0) = po, F(t, 1) = p\ and initial condition F(0, x 
define v ± by 



rx with boundary conditions 
^^ Set u± = s'iF*) and 



F?W 



1 



u~ 



1 + e** ut(E-ut) 

Then v ± (0) = p and v ± (t) converges to p E as t — > +oo. The paths v ± reversed in time 
are two optimal paths for the variational problem (E]). 



Lagrangian phase transitions 9 

6. Discussion 

We conclude with some remarks on the possibility of observing Lagrangian phase 
transitions. In noisy electronic devices with a finite number of degrees of freedom 
optimal paths have been experimentally observed [22j|23]. In Langevin equations with 
noise, Lagrangian singularities have been observed in simulations [9j[10]. In this paper 
we have shown analytically that they occur in a simple model with infinitely many 
degrees of freedom. In thermodynamic systems the thermal fluctuations are very small 
and the direct observation of Lagrangian phase transitions does not appear feasible, as 
it would require an extremely long time. On the other hand, the problem of large 
fluctuations admits an interpretation as a control problem [21]. This means that 
rather than considering the optimal path, we look for the field driving the system 
from the stationary state to a chosen profile with the minimal energetic cost. The 
Lagrangian phase transition then corresponds to the existence of two different optimal 
fields dissipating the same energy. In principle, these two fields can be theoretically 
calculated and an experiment can be designed to check the predictions. 
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